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Abstract 



The flavor changing neutral top quark decay t — > cX is computed, where X is a neutral standard 
model particle, in a extended model with a single extra dimension. The cases for the photon, X = 7, 
and a Standard Model Higgs boson, X = H, are analyzed in detail in a non-linear gauge. We 
find that the branching ratios can be enhanced by the dynamics originated in the extra dimension. 
In the limit where 1/R » mt, we have found Br(t — > 07) ~ 1CP 10 for 1/R = 0.5TeV. For the 
decay t — ► cH, we have found Br(t — ► cH) ~ 1CP 10 for a low Higgs mass value. The branching 
ratios go to zero when 1/R — ► 00. 
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I. INTRODUCTION 



Flavor changing neutral currents (FCNC) are very suppressed in the standard model 
(SM): there are no tree level contributions and at one loop level the charged currents operate 
with the Glashow-Iliopoulos-Maiani (GIM) mechanism. The branching ratio for top quark 
FCNC decays into charm quarks are of the order of 10~ n for t — > eg and 10 -13 for t — > 
cy, (Z) in the framework of the SM 

HQ. 

This suppression can be traced back to the 
loop amplitudes: they are controlled by down-type quarks, mainly by the bottom quark, 
resulting in a ml/M^ factor which can be compared to the enhancement factor that appears 
in the b — > 57 process where the top quark mass m t is involved instead of m& in this factor. 
This fourth power mass ratio is generated by the GIM mechanism and is responsible for 
the suppression beyond naive expectations based on dimensional analysis, power counting 
and Cabibbo-Kobayashi-Maskawa (CKM)-matrix elements involved. The top quark decay 
into the SM Higgs boson is even more suppressed [l, 2]: Br(t — > cH) ~ 10~ 13 — 10~ 15 for 
Mz < Mh < 2Myy- These rates are far below the reach of any foreseen high luminosity 
collider in the future. The highest FCNC top quark rate in the SM is t eg, but this value 
is still six orders of magnitude below the possibility of observation at the LHC. 

The discovery of these FCNC effects would be a hint of new physics because of the large 
suppression in the SM. These FCNC decay modes can be strongly enhanced in scenarios 
beyond the SM, where some of them could be even observed at the LHC or ILC. New physics 
effects in extended Higgs sector models, SUSY and left-right symmetric models were studied 
in references [1-5]. For example, in various SUSY scenarios the branching ratios can go up 
to the value 10 -5 for the decay t — > eg. Also, virtual effects of a Z' gauge boson on these 
rare top quark decays were studied. The decay t — > cy has been analyzed in reference 6] , it 
has been shown that B(t —* cy) is at the 10 -6 level in topcolor assisted technicolor models 
for m' z = 1 TeV, which would allow the detection of this process at future colliders. 

On the other hand, the use of effective Lagrangians in parameterizing physics beyond the 
SM has been studied extensively in FCNC top quark couplings and decays [3, Isl, 0] • This 
formalism generates a model-independent parameterization of any new physics characterized 
by higher dimension operators. Under this approach, several FCNC transitions have been 
also significantly constrained: t — > cy 10, ll|, t — » eg [ll|, Q, /j — > lj*y [3] and H — > Z^Z 
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New physics effects have also been introduced in models with large extra dimensions (ED) 
In recent years, these models have been a major source of inspiration for beyond the 
SM physics in the ongoing research. In these scenarios the four dimensional SM emerges 
as the low energy effective theory of models living in more than four dimensions, where 
these extra dimensions are orbifolded. The presence of infinite towers of Kaluza-Klein (KK) 
modes are the remanent of the extended dimensional dynamics at low energies. The size 
of the extra dimensions can be unexpectedly large, with 1/R at the scale of a few TeV 
without contradicting the present experimental data [if]]. Then, if these KK-modes are 
light enough, they could be produced in the near future at the next generation of colliders. 
Scenarios where all the SM fields, fermions as well as bosons, propagate in the bulk are 



known as "universal extra dimensions" 
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18] . In these theories the number of KK-modes 



is conserved at each elementary vertex and the coupling of any excited KK-mode to two 
zero modes is prohibited. Then the constraints on the size of the extra dimensions obtained 
from the SM precision measurements are less stringent than in the case where there is no 
conservation of the KK particles (non universal extra dimensions). 

The impact of the new physics coming from UED models has been widely studied and 
constraints on the parameter 1/R have been obtained. Analysis of the precision electroweak 
observables led to the lower bound 1/R> 700 — 800 GeV for a light Higgs boson mass and 
to 1/R> 300 — 400 GeV for a heavy Higgs boson mass [19]. On the other hand, using the 
)rocess b — > s'j, the resulting bound on the inverse compactification radius is 1/R > 250 GeV 



201 ] . Moreover, a recent analysis making use of the exclusive branching ratio B — > K*^ shows 



that under conservative assumptions 1/R > 250 GeV [21]. And from the inclusive radiative 
B — > AT S 7 decay, a lower bound on 1/R> 600 GeV at 95% C.L. can be obtained and it is 



independent of the Higgs boson mass value 



221 ] . Contributions from UED models have been 



considered on several FCNC processes, reference [23| has found that the processes K L — > 
TT°e + e~,AM s ,K + — > tt + vv,K l — > TT°uu,B dyS — > X diS uu,K L — >■ ^ + /i~,B djS — > fi + fi~,B — >■ 
X s fi + fi~ for 1/R?z 300 GeV are enhanced relative to the SM expectation and the processes 
B — > Xgj, B — > X s g, e'/e are suppressed respect to the SM. In general, the present data on 



FCNC processes are consistent with 1/R> 300 GeV [23|,|24|. Exclusive B -> K*l + r,B 



K*vv and B s decays 2l|, |25j have been studied in the framework of the UED scenario and 



also rare semileptonic A^ decays 



26|. 



In this paper we study the FCNC decays of the top quark in a universal extra dimension 
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theory where all the SM fields live in five dimensions. In particular, we compute the t — ■> 07 
and t — > cH decay modes in a non linear R^. This gauge has the advantage of a reduced 
number of Feynman diagrams as well as simplified Ward identities. These facts facilitates 
and clarify the calculation. 

The paper is organized as follows: in section II we present the general framework for the 
five dimensional Lagrangian and derive the corresponding four dimensional Lagrangian and 
Feynman rules. In section III and IV we compute the decays mode t — > C7 and t — > cH 
respectively, and discuss the hypothesis implicit in the calculation. Finally, in section V we 
present some conclusions. In the Appendix (section VI) we show the terms in the Lagrangian 
that are important for the Feynman rules in our calculation. 



II. THE MODEL 



We begin presenting the SM Lagrangian in five dimensions; let x = 0,1,2,3 be the 
normal coordinates and x A = y the fifth one. The fifth extra dimension is compactified 
on the orbifold S 1 /Z 2 orbifold of size R which is the compatification radius. We consider 
a generalization of the SM where the fermions, the gauge bosons and the Higgs doublet 
propagate in the five dimensions. The Lagrangian L can be written as 

L = J d 4 xdy(C A + C H + C F + C Y ) (1) 

with 

1 1 

r — u/ MNa u/ a r>MN jd 

La - -^W w MN --B Bmn, 

C h = (D M $)W-n*). 

C F = [Q{iV M D M )Q + U(iT M D M )U + D(iT M D M )D] , 

C Y = -QYu$ c U - QY d §D + h.c. (2) 

The numbers M, N = 0, 1, 2, 3, 5 denote the five dimensional Lorentz indexes, W^ N = 
9mWn — djyW^ + ge abc Wl I W^ is the strength field tensor for the SU (2) L electroweak gauge 
group and Bmn = 9mBn — 9nBm is that of the U(l)y group. The gauge fields depend 
on x and y. The covariant derivative is defined as D M = <9m — igW^T a — ig'B M Y, where 
g and g' are the five dimensional gauge couplings constants for the groups SU(2) L and 
U(l)y respectively, and T a and Y are the corresponding generators. The five dimensional 
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gamma matrices Tm are = 7^ and T 4 = 275 with the metric tensor given by gMN = 
(+, — , — , — , — ). The matter fields Q, D and U are fermionic four components spinors with 
the same quantum numbers as the corresponding SM fields. To simplify the notation we 
have suppressed the 577(2) and color indices. The standard and charge conjugate doublet 
standard Higgs fields are denoted by $(x, y) and $ c (x, y) = ir 2 $*(x, y); Y u ^ are the Yukawa 
matrices in the five dimensional theory responsible for the mixing of different families whose 
indices were suppressed in the notation for simplicity. We have not included in Eq. ([2]) the 
leptonic sector nor the SU (3) c dynamics because it is not relevant for our proposes. The low 
energy theory will only have zero modes for fields that are even under Z2 symmetry: this is 
the case for the Higgs doublet that we choose to be even under this symmetry in order to 
have a standard zero mode Higgs field. The Fourier expansions of the fields are given by: 



B 5 (x,y) 

Q(x,y) 
U(x,y) 
D(x,y) 
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ny 
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(3) 



VrcR 

The expansions for and B$ are similar to the expansions for the gauge fields and the 
Higgs doublet (but this last one without the fi or 5 Lorentz index). It is by integrating 
the fifth y component in Eq. (TjQ) that we obtain the usual interaction terms and the KK 
spectrum for ED models. 

The interaction terms relevant for our calculation will be written in a non-linear R^ 
gauge (see for details 27] and the first reference in {5]). For example, in this gauge there is 
no mixing between the gauge bosons and the charged and neutral unphysical Higgs fields. 
Besides, the interaction terms are simplified in such a way that there are no trilinear terms 
such as W^G^A^, where is an unphysical Higgs field. We are interested in the third 
family of quarks and Qt and are the upper and lower parts of the doublet Q. Similarly, 
the Ui n) and are the KK modes of the usual right-handed singlet top and bottom quarks, 
respectively. There is a mixing between the mass and gauge eigenstates of the KK top quarks 



(Qt^ and U^) where the mixing angle is given by tan(2a") = m t /m n with m n = n/R. For 
the b quark the mixing is quite similar, but at leading order the only masses that remain 
are m t and m n and in this limit the mixing angle is zero. This leads to the spectrum 



m Qb = m ™ an d m Qt = m u n — a/ ml + m\ for the excited modes of the third family. After 
dimensional reduction, the fifth components of the charged gauge fields, W 5 mix with 
the KK modes of the charged component 4>~^ of the Higgs doublet. The unmixed states 
are thus the charged physical boson G^™' 1 excited state and a would be Goldstone boson 
<f>G^ that contribute to the mass of the KK gauge bosons: 

Mn) = m n W± in) +iM w <P±^ m^o ±(n) 
±{n) _ iM w wt in) + m n ^ , ±(n) 

V m n + M W 

The final expression for the lagrangian can be found in the Appendix A, where we show 
the terms that contribute to the decays we are interested in. 



III. THE t ->■ c 7 DECAY RATE 

In this section, we present the calculation at one-loop level of the t — > cj process in 
the framework of a 5-dimensional universal ED model. We start with a naive calculation 
comparing the decay widths calculate in the SM and ED model and assuming that in the 
ED model only the third generation is running in the loop. The one loop SM width for the 
top quark decay into a charm quark plus a gauge boson can be approximated by 

r(t^cV)c\V bc faal m m t [^j (l - (5) 

where for a photon, the neutral gauge boson and a gluon we have a = a em (V = 7, Z) or 
a = a s (V — g) respectively. These results can be compared to the ones expected for extra 
dimensions, where the ratio rrib/Mw is replaced by M^jm n . Using these approximations 
we can naively estimate the ratio, 



T(t -> C1 ) ED 
r(i -> cj)sm 



(m b /M w y 



(6) 
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The sum on the KK tower of excited states can be evaluated as we will explain later in the 
text and we obtain 



T(t -> c-f) E p _ 
F(t -> cj) SM 36 



(M w /(1/R)) 



1.2 x 10 2 (7) 



(m b /M w ) 

for R~ x ~ 0.5 TeV. We have already mentioned that the SM prediction for the branching 
fraction for the decay t — > cy is of the order Br(t — > 07) ~ 10~ 12 . Then, from Eq. (J7j) the 
branching fraction for ED models is Br(t — > cj)ed ~ 1 x 10~ 10 for = 0.5 TeV. 

The naive result on the T(t — > cj)ed motivates a complete analysis of the one loop 
amplitude in extra dimensions. The general transition qi — > qj + 7 for arbitrary quark 



flavors i, j in a non linear gauge was studied in reference [27J], where it was found that a 
reduced number of Feynman diagrams as well as simplified Ward identities greatly facilitates 
the calculation in this R^ gauge. 

For on-shell quarks and real photons the transition matrix element is given by 

M M = ia^k v {Fim c P L + F R m t P R ), (8) 

where fc M is the photon momentum, P Rj l = (1 i 7s)/2 and the magnetic transition form 
factors F 2 ' R are 

2F 2 L m c = {B 1 + B 3 + 2B 5 )m t - A 3 m c + A 12 - 2A U , (9) 

2F 2 R m t = (A, + A 3 + 2A 5 )m t - B 3 m c + B l2 - 2B n , (10) 

where the Ai,Bi form factors are gotten from the most general Lorentz structure of the 
renormalized proper vertex \27\\ . 

Electromagnetic gauge invariance restricts the amplitude of this decay to the form 

2 

M{t-+ cry) = % *\ 2 e* k, (2F R m t ) u c a^P R u t (11) 

where cw is the cosine of the weak mixing angle and the form factors F 2 R and F 2 R are related 
by 

F R m = e / f 2 r . (12) 
2 32c 2 w 7r 2 mt 2 K J 



The decay width for this process can be written as 

a 3 m t 



nt - c 7 ) = ^?Vl^| 2 - 4.8 x 10-WI 2 - (13) 



In order to perform the one loop calculation, we consider two scenarios. The first one, 
when the mass of the excited states associated to the quarks from the three low-energy 
families are quasi-degenerated at tree level, without any kind of radiative corrections to KK 
masses. In this case, when the excitations coming from the other quarks are taken into 
account, the transition amplitude for the process t — ► cry takes the form 

(n/R) 2 + mf 

i=d,s,b \ i / i 

" ^ wwt 1 (14) 

where the last line can be obtained using the unitarity of the CKM matrix and considering 
that the electroweak corrections of the first two families are of order zero, is the mass 
of the down quark running into the loop. Therefore in this scenario, we notice that the 
naive expectation of the decay width T(t — > 07) given by (|7j) is suppressed by the factor 
(m& / (n j -R)) 4 , and then the final result, including the KK states, is smaller than the SM 
value. 

In the second scenario, we consider that the most important contribution to the loop 
correction comes from the excited KK states associated to the third generation. This is a 
more realistic scenario because there is a mass hierarchy in the KK states from the different 
families, such as at low energy. We should mention that in universal extra dimension theories, 
the fixed points from the orbifold break the translational symmetry of the extra dimension 
and it is possible to introduce new interactions on the branes. In these new interactions, 
there are counterterms that cancel the divergences of the radiative corrections, mass terms, 
and mixing terms from the different family KK modes 28| . All our results are presented in 
the context of this scenario. 

Some of the Feynman rules for the model of Section II can be found in the Appendix 
where all the relevant terms are shown. In Figure 1, we illustrate the topology of the one- loop 
diagrams that are contributing. 

In all the decays we are interested in, we neglect corrections of order [m c j My/) 2 . The 
mixing angle between the gauge and mass eigenstates for the KK excitations of the quarks 
are written in section [Til and are zero for the leading order approximation. Other possible 
contributions are neglected due to the Yukawa coupling constants. For example, diagrams 
involving are proportional to the Yukawa coupling A c , and therefore to m 2 . 
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(1) 



(2) 



FIG. 1: Diagrams contributing to the t — * 07 decay in the non linear gauge. 

Diagrams with G^^ in the loop are proportional to and then to ml and can be 

neglected. 

The leading contributions of type 1 diagrams (see figure 1) to the decay come from the 
following particles circulating in the loop: 

wi n) Q { : ] Qt\ WPQ™Q?\ GtyQFQ?\ G^D^D™. (15) 

where the external photon is coupled to the fermion in the loop. The sum of all these 
diagrams gives, for the form factor F 2 R , the following expression 

2 o „ i f 1 , f 1 ^ , 1-w-z 



2Ff = - 3 ^v lt v: b — j i w „ 



X 



2 

Z+(l-«,)+ Z » 



(16) 



where the factor X comes from the dimensional regularization tricks of the product of inverse 
propagators of the particles circulating in the loop 

X = m 2 t z 2 + m 2 wz — m 2 z + m 2 n . (17) 

The main contribution of type 2 diagrams (see figure 1) is the one with KK excitation of 
the standard model gauge boson or a scalar field circulating in the loop which are coupled 
to the external photon: 

w( n )w( n )n( n ) M/( n h/f/ (n )n (n ) ^WrWriW ^WrWnf™' 
(G^W^Q^ + W^G^Q^). (18) 
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These terms contribute to the F 2 form factor with the following expression 

% f 1 f x ~ z 1 

2F 2 R = -g 2 e-— i V tb V* b dz dw^ {4(2 - 3w - 4z + 2wz + 2z 2 
167T J J x 



1 — w 



(w + z) - (w + z- 1/2) 



M 2 W 



(19) 



For a mass scale of the excited states much higher than the electroweak scale, i.e., m n 3> m t , 
the denominator can be approximated by X ~ m^. We also consider that the excited quarks 
rotate from interaction to mass eigenstates with the same matrix of the ordinary quarks. So, 
in the Yukawa lagrangian the interactions QbL^R Gyv^ anc ^ QbL c R G^ are proportional 
to Vtb and V c b respectively, in the mass eigenstates. If we compare the leading contribution 
coming from these diagrams respect to the SM contribution [2j, it is 

— ■ ^ J- (20) 

The numerical estimation of all these contributions is straightforward. All the excited mass 
terms are proportional to n/R, except for the electroweak correction coming from the sym- 
metry breaking. From the numerical point of view this correction does not change the results 
and can be neglected without modifying the final estimates. Based on these hypothesis, we 
can also take X ~ vn? n and, then, the sum over all the KK excited states can be easily done, 
as 

where in any numerical estimate 1/R ~ 0(1) TeV. 

Thus, within this approximation, the sum over all the excited KK states is equivalent to 
multiply the results obtained for the first KK excited state by the factor tt 2 /6. The sum of 
all contributions using equations (fl~6l) and ( fl~9l) gives, 

2F 2 R = i^V tb V; b -^ dz dw^ {-22 + 35w-w 2 

2 

+ 51z - 30wz - 29z 2 + (-4z 2 - Awz + lOz + 6w + 3)—±- 

2M{ V 

~4k v ^M-\ +ii w)- (22) 

By using equations ffTB"]) and ffT2l) . the numerical value for the decay width is 

T{t -> erf) = 1.65 x 1(T 10 GeV , (23) 
10 



for R 1 = 0.5 TeV, and the branching fraction is 

Br(t - cry) ee = L ° 8 X 10_1 °- (24) 

This result shows a branching ratio above the SM one, two orders of magnitude. 

IV. THE t -» cff DECAY RATE 

The invariant amplitude for the flavor changing decay of a top quark into a charm quark 
plus a SM Higgs particle can be written as 

M(t -> off) = rx c (p) (F L P L + F^) u 4 (/c), (25) 

where Fl and Fr are form factors. In our notation we identify the external scalar Higgs H 
with the zero mode Higgs field . From this amplitude we can compute the decay width 

r(«-^ = ^(i-5)'(W + W)- <*) 




(1) 
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(2) 



73 



(3) 



H 



FIG. 2: Feynman diagrams for the t — > cH decay in extra dimensions. 

The leading diagrams that contribute to the decay are shown in Figure 2. The leading 
group of type 1 diagrams in figure 2 is the one with KK excitations of the SM quarks 
circulating in the loop which are coupled to the external higgs: 



w5 b) qW, g8?qW, w^Q^Df- 



(27) 
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In this case, the external Higgs is coupled to the excited quark Q b generating a flavor 
changing Q^ n 'D b h^ (see the appendix), which is proportional to the bottom quark mass 
m&. The contributions to the F^, Fr form factors are of the order of zero at leading order, 
i.e.F L = F R *0. 

The leading diagrams of type 2 in figure 2 is the one with KK excitations of the standard 
model gauge bosons and scalar fields circulating in the loop which are coupled to the external 
higgs boson h^: 

wtowi n) QP, gWgPqP, WWWWQP, W^G^Qt\ 

G®WV>Q?\ (W^G^Q^ + G^W^Q^), (28) 

and these contribute to the form factor with the following expressions: 

F L = g 3 V tb V; b -^ f dz f dwL {2(1 -w)m t M w 



Uz — l)(w + z)m\ + w(z — 2)m%\ 



m w 

F R = 9 3 V tb V; b -^ I dz f dwL {wm t M w } . (29) 
J- 1371 " Jo Jo X 

After evaluating the parametric integrals, the form factors are given by 

Fl = V tl Vi ' !sM w m, + M + , 
67724 16n 2 I M w 2m w J 

Finally, the type 3 diagrams in figure 2 coming from a renormalized flavor changing fermion 
line, do not contribute at leading order to the decay width. The first one of these diagrams 
is proportional to the charm quark mass because of the Higgs coupling, and therefore is 
negligible. For a similar reason, the second diagram has a top quark mass factor, but the 
self-energy part introduces the charm quark mass and this contribution is suppressed respect 
to the leading order. 

From these form factors and equation (|26p . we compute the t — ► cH decay width. Finally, 
the branching ratio is Br(t — > cH) = 1.08 x 1CT 10 , for m H = 120 GeV . 

V. CONCLUSIONS 

We have computed the decay widths T(t — > 07) and T(t — > cH) in a universal extra 
dimension model with a single extra dimension, where we have considered that the most 
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important contribution to the loop correction comes from the excited KK states associated 
to the third generation. The results show a branching ratio that is above the SM one. The 
branching ratios for these two decay widths are of the order of 1CT 10 . 

There is a strong dependence on top quark mass m t in the amplitude of the t — > cH 
process, it is coming from the type 2 diagrams in figure 2 with an excited scalar in the loop, 
resulting in a m^/M^ factor. When we take the limit m n ^> m t , we find that the decay 
widths for the t — > 07, (H) processes are decoupled respect to the new scale 1/R and they 
go to zero. Considering that the excited states of the quarks are quasi-degenerated and the 
unitarity of the CKM matrix, the amplitudes for the flavor changing decay t — c due to the 
contribution of the excited states of the quarks, are suppressed by the factor (rrib/(n/R)) 2 , 
and the predicted values are smaller than the SM predictions. 
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VII. APPENDIX 



The Lagrangian can be separated in different terms as in the following sum: 



00 



l= E ( 31 ) 

m=l,2,3 n=l 

After symmetry breaking the interaction terms are included in the terms up to 
The first one, is 

L<»> = -^-QfttfG^ - -^-D^tfG^ + h.c. (32) 
1 V2M W bL R W V2M W v ! 

The second term, has the excited gauge boson-fermion interactions: 



4*> = *-eAf Q^Q^+u^u^ +\±W+MQ<fi!>ft 



(o) 

L 



9 o(™)+(°)u/-( n ) 



V2 



+ 2e^4°) [?;W< W - W+^W 5 - {n) ] +h.c.} 



(33) 
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And the third term has the neutral Higgs boson interactions: 

L (n) = _9H±QW u W h(0) _ i^Q^W^O) 

+ gM w W+ {n) W- (n) h^ + gMwW^W-WhM 

,2 



2M W u u 

+ 



§^ 5 (n) G+ (n) /i<°> + i|w+W>^G# n) + /i.e.} (34) 
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